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Michael Pickering: 


SOME OBSERVATIONS ON CLOZE TESTS 


The claoze test’ cam be described very simply: the 
student is’required to fill‘ the gaps appropriately 
where every nth word: is deleted in a text. Sirst’ 
devised by Wilson Taylor for detérmining the 
readability of texts, the "cloze' proeedure has 
been, so to speak, inverted to.form a test of a 
reader's ‘ability to predict what word will occur on 
the basis of the context. (The predictability is 
sometimes called "expectancy", although this term 
is not quite appropriate to a written text, where 
the following as well as the preceding context may 
be used to determine what word has been omitted; v 
"expectedness" might be preferred, but on the other 
hand "expectancy”’, like prediction, is used without 
res;ard to time-order in mathematical discourse. ) 


There are twa methods of marking a cloze test. Ther 
first is’ called "narrow": ohly the exact word omitted 
is counted as correct; the second is called "broad": 
any acceptable word is counted a8 correct. Neither 
type of markings can be done by tye optical reader 

and computerysystem used here at ‘present to mark 
multiple-choice tests in university entrance 
examinations. The narrow marking however is a quite 
é6pbjective procedure: it does not vary with the 

person doping it. Broad marking may 30 vary, and 

must be standardised. in a group test. 

When compared with other languare tests, the cloze 
test appears to be a good one. With narrow marking, 
it. shows a correlation of .76 with listening 
comprehension (mult @ple-choice) and .69 with ~ 
dictation, which tests, together with structures, 
vocabulary and reading comprehension, form the five 
subtests in the TOEFL vattery of tests. -The above 
correlations are higher ‘than army found between the 
Subtests of the TOEFL battery; or.between any one 
subtest and the rest of the subtests, excepting 

only listening comprehension. (See "Cloze, Dictation 
and the TOEFL", J.W. Oller Jr., Patricia Irvine and’ 
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Statistically, language-tests measye variation in 
language ability through active or’passive use of 
written or sroken language. This dqes not mean-that 
the tests measure the "subskills", as they are 
nowadays calléd, of listening, speaking, reading 
and writing. The form (sometimes called "the 
mechanics") of both multiple-cho#c& and cloze tests 
requires the exercise ‘of abiliti rather unlike 
those_used in liégtening, etc. inSayversday life. 
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° ; he ugual multiple-choice test called ‘reading 
; eect ene for example, would be more exactly 
characterised as a test of "academic reading 
a - 8 * ability" (defined as reading for information and 
sa = making inferences from what is read), or, in a 
a ‘ roughly equivalent way, as a test of the ability to 
. use textual matter in self-instructilon. Corre- 
% ‘ spondingly, the cloze test would be usefully under- 
. ‘stood as a test of the ability to st a text in.. 
detail, as in critical reading or proobyreadins. 
The point here is, that when we read in @veryday 
. . life, we usually do. not pose ourselves, or have 
f- posed to us, a number of questions, equally spread. 
es, = ; over the text, or, similarly, ‘a number of statements 
with which to agree or disagree; Meither do we, in 
our everyday reading, notice or utilise every nth 
word. The cloze test and the multiple choice test 
therefore cannot be considéred as requiring oniy 
those’ abilities used in everyday reading, even 
; though they predict these abilities rather well. 
DS Since it is generally agreed that the-abilitie 
‘ ‘needed to perform in a test do, and perhaps should, 
* influence the teaching given (whéther we wish ift | 
or not), the question should be asked, "What ar 
the abilities required to perform in fhe cloze test?" 
What we propose to do in the remaining part of this 
+ article is to provide some ad_ hoc answers to this 
* question, by means of examples, interpreting |. 
al "abilities" in'a general unsystematic sense. : 
shall suggest four abilities - additions or modifi 
. cations to these are naturally to be: expectec. | 
a They are: l.« Knowledge of vocabulary 2. Knowledge 
of collogation and colligation >. Attention to ‘| | 
» nearer and farther context 4. Flexibility as to |. | 
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word and context interchanpeability. ~~ 
| 
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7 EXAMPLES * 


Below are two fragments of possible cloze tests, 
‘based on the same text. The first has gaps five | 
eR os . words apart, the second, six wosds apart; the first 

begins at word. 6, the Second .at word 0. \ 


“Me” 


Peter Roe visited Finland ----- strongly advoeate 

the use of ----- cloze test of language skill. 

----- talk to a workgroup of ----- Confergnce of \ 

Nap Enflish Departments is 7---- in the C.&.f. report | 
1975 ; 


S (1) Earlier this year, British Council ----- a 


(2) sse5 this year, British Council’ Testinre expert 

sere Roe visited Finland and strongly advocated 

=Hs== use of this test of language -----. His talk 

; oa to a workgroup Of?—---- Conference of English 

e . . Departments ig summarised ----- in, the C.E.D. 
report 1975. 
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We will il llustr&te the four above-ment fened abilities 
. from these two fracments. 
]. Knowled;e: of vocabulary. This is rather 'specific 
to fillins the lasg cap in (1).-."Reported" or \ 
"written" would be relatively unacceptable compared 
with "summarised". "Included" would be onty fairly 
acceptable. ; - . > 
2. Knowledge of collTocation. .™he tendency for’ 
certain, words to occur together is called "colloca- 
tion’. | "Earlier’, the exact word for the first gap 
in (2) collocates with "year". Tne requirement for 
certain words to occur together is scrictly'called 
"colligation". “The rules of adjective order rule 
out "well-known" in the second sap in (2), althodgh 
"well-known" may easily collocate gith a personal 
name. Textual cohesion rules (thug colligation) 
will rule out "there" in the last gap.in (2) -a 
place phrase follows, and "there”™ would duplicate. 
the reference. . 
3. Attention to nearer and farther context. “During” 
in the first tapyin (2) would be wholly acceptable 
on the basis of nearer context. "Visited" however 
is likely to specify a definite time, which "during" 
does not. Compare "has visited", "has been in/ 
visitins". Note also that "strongly advocated" has 
the same tense as "visited". This much,context:is 
feeded to show that "earlier" is more acceptable 
than "during" ‘ 
4, Flexibility as to wotn and context irterchange-’ 
ability. In thé third sap in (fr) there is-a choice 
between "a", "the" and certain other words. In 
vanother test based ‘on this text, the word "the" 
before "use" could have been omitted, and,the word 
"the" before "cloze" included. The interdependence 
of the articles in these’ two positions is shown 
by the fact that-"the" + "the", "the" + "a", "a" +. 
"the", and "a" + "a" are acceptable decreasingly in ... 
that order. The possibility certainly exists thate 
the word use to fill one gap would affect the choice 
of word to fill another gap. ‘ord and context 
interchange. An example cf this coes nat occur 
however in the above frag ments, as far as we can 
jude. 


The-cloze test, then, it is suggested, requires for 
its performance certein "abilities", in a non- 
technical sense of that word, wnich are not =*« 
necessarily implied in the languas’e skills, such as 
reading and listening, with which performance in 
the cloze test is known to correlate. Four of 
these: "abilities" have been discussed above: they 
are, attention to nearer and farther context; 
knowled;se of likely collocations and colligations 
(i.e. of words which, for one reason or another, 
are likely to occur in the same context), 
flexibility in tree ting a (pevhaps hypothetical) 
word inserted inf’ ap in the text as“context for. 
further predictions, ani kncowledie of vocabulary. 
A > ‘ 


